Hearing a talking face: an auditory influence on a visual detection task
نویسندگان
چکیده
Parsing of information from the world into objects and events occurs in both the visual and auditory modalities. It has been suggested that visual and auditory scene perception involve similar principles of perceptual organization. This study investigated cross-modal scene perception by determining whether an auditory stimulus could facilitate visual object segregation. Specifically, we examined whether the presentation of matched auditory speech would facilitate the detection of a point-light talking face amid point-light distractors. An adaptive staircase procedure (3 up 1 down rule) was used to estimate the 79% correct threshold in a twoalternative forced-choice (2AFC) procedure. To determine if different degrees of speech motion would show different sized auditory influence, three speech modes were tested (speech in quiet; whispered and Lombard speech). A facilitatory auditory effect on talking face detection was found; the size of this effect did not differ across the different speech modes.
منابع مشابه
Detection of audiovisual speech correspondences without visual awareness.
Mounting physiological and behavioral evidence has shown that the detectability of a visual stimulus can be enhanced by a simultaneously presented sound. The mechanisms underlying these cross-sensory effects, however, remain largely unknown. Using continuous flash suppression (CFS), we rendered a complex, dynamic visual stimulus (i.e., a talking face) consciously invisible to participants. We p...
متن کاملSearching for a talking face: the effect of degrading the auditory signal.
Previous research (e.g., McGurk & MacDonald, 1976) suggests that faces and voices are bound automatically, but recent evidence suggests that attention is involved in a task of searching for a talking face (Alsius & Soto-Faraco, 2011). We hypothesized that the processing demands of the stimuli may affect the amount of attentional resources required, and investigated what effect degrading the aud...
متن کاملObjective Peak-Detection in Complex Auditory Brainstem Response to /ba/, /da/, /ga/: A Novel Technique
Objectives: The result of auditory brainstem response is used worldwide for detecting hearing impairments or hearing aids. This study aimed to introduce the superiority of mathematical innovation algorithm toward subjective evaluation by an audiologist. The automatic algorithm method is encouraged for detecting the waves of Auditory Brainstem Response (ABR), because it can reduce subjective eva...
متن کاملContributions of oral and extraoral facial movement to visual and audiovisual speech perception.
Seeing a talker's face influences auditory speech recognition, but the visible input essential for this influence has yet to be established. Using a new seamless editing technique, the authors examined effects of restricting visible movement to oral or extraoral areas of a talking face. In Experiment 1, visual speech identification and visual influences on identifying auditory speech were compa...
متن کاملAudio-Visual Prosody: Perception, Detection, and Synthesis of Prominence
In this chapter, we investigate the effects of facial prominence cues, in terms of gestures, when synthesized on animated talking heads. In the first study a speech intelligibility experiment is conducted, where speech quality is acoustically degraded, then the speech is presented to 12 subjects through a lip synchronized talking head carrying head-nods and eyebrow raising gestures. The experim...
متن کامل